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TITLE 

METHOD AND APPARATUS FOR DEFECT COMPENSATION IN AN IMAGE 

SENSOR 

BACKGROUND OF THE INVENTION 

5 Field of the Invention: 

The present invention relates to defect compensation in 
an image sensor and particularly to a method and apparatus 
for defect compensation in a color image sensor without 
using large memory or line buffer. 

10 Description of the Prior Art: 

The CMOS image sensor is an innovative sensing 
technique compared to the traditional CCD, as it offers 
lower power consumption, higher system integration 
capability, and CMOS process compatibility. However, the 

15 CMOS image sensor suffers from weak defects, warm pixels, 
and poor FPN performance due to the difficulties in 
controlling the CMOS process. Despite these drawbacks, the 
high resolution CMOS image sensor is rapidly gaining 
popularity in the DSC market due to its low cost, because of 

20 this, the defect compensation performance of the CMOS image 
sensor has become a key issue. 

There are two main types of defect compensation used in 
CMOS image sensors. One is in-process calibration and the 
other is on-chip compensation. 

25 With in-process calibration, the locations of the 

defective pixels are identified by testing the pixel array 
and permanently stored in a memory device in the sensor. 
When the processor receives image data from the pixel array. 
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it reads the defect information from memory and accordingly 
corrects the values of the defective pixels so that the 
compensated image data is finally output from the sensor. 
This advantage of this is that the defective locations are 
5 already known and the processor never wrongly locates the 
defects. However, in-process calibration raises a need for 
additional memory to store the defect information, which 
increases the cost of the sensor. 

With on-chip compensation, the locations of the 

10 defective pixels are identified in real time. When the 
processor receives image data from the pixel array, it 
locates the possible defects by a specific algorithm and 
corrects the values of the located defective pixels so that 
the compensated image data is finally output from the 

15 sensor. The advantage of this is that no memory is required 
to permanently store the defective locations. However, on- 
chip compensation easily results in image distortion due to 
normal pixels being mistakenly identified as the defects. 
For example, if the original image includes a column of dark 

2 0 pixels as shown in FIG. lA, the processor will mistakenly 
identify these dark pixels as defects since they are '"peaks" 
compared to their adjacent pixels. Thus, these pixels are 
''corrected" so that the line in the original image 
disappears, as shown in FIG. IB. Further, conventional on- 

25 chip compensation also raises a need for a line buffer to 
temporarily store essential data for calculations in the 
algorithm, which increases the cost of the sensor. 
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SXmMARY OF THE INVENTION 

The object of the present invention is to provide a 
method and apparatus for on-chip defect compensation of a 
color image sensor without using a large memory or line 
5 buffer. 

The present invention provides a method for defect 
compensation in a color image sensor having pixels. The 
method comprises the steps of predetermining a first and 
second threshold, and defining a window, identifying peak 

10 and normal pixels, wherein the peak is one of the pixels 
that has a color difference larger than the first threshold 
from two adjacent pixels of the same color, and the normal 
pixels are those other than the peak, identifying the peak 
as a defect if each of the two pixels immediately adjacent 

15 to the peak has a color difference smaller than the second 
threshold from two adjacent pixels of the same color, and 
all the pixels in the window positioned according to the 
location of the peak are normal pixels, and correcting a 
color value of the defect . 

20 The present invention also provides an apparatus for 

defect compensation in a color image sensor having pixels, 
the apparatus comprising a memory device, and a processor 
implementing the steps of predetermining a first and second 
threshold, and defining a window, identifying peak and 

25 normal pixels, wherein the peak is one of the pixels that 
has a color difference larger than the first threshold from 
two adjacent pixels of the same color, and the normal pixels 
are those other than the peak, storing a plurality of data 
bits in the memory device, wherein each of the data bits 
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indicates one peak and one normal pixel, identifying the 
peak as a defect if each of the two pixels immediately 
adjacent to the peak has a color difference smaller than the 
second threshold from two adjacent pixels of the same color, 
5 and all the pixels in the window positioned according to the 
location of the peak are normal pixels, and correcting a 
color value of the defect . 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood 
10 from the detailed description given hereinbelow and the 
accompanying drawings, given by way of illustration only and 
thus not intended to be limitative of the present invention. 

FIG. lA and IB show mistakenly identified defects 
resulting from the conventional on-chip compensation. 
15 FIG. 2 shows a 16*16 color pixel array. 

FIG. 3 is a flowchart of a method for defect 
compensation in a color image sensor according to one 
embodiment of the invention. 

FIG. 4 shows an apparatus for defect compensation in a 
20 color image sensor according to one embodiment of the 
invention. 

DETAILED DESCRIPTION OF THE INVENTION 

A general procedure for on-chip compensation according 
to one embodiment of the invention will be with reference to 
25 FIG. 2 which shows a 16*16 color pixel array. The following 
procedure is iterated for each of the pixels in the array. 

First, it is determined whether the currently selected 
pixel is a peak. The current pixel is identified as a peak 
if it has a difference larger than a threshold Tl from two 
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adjacent pixels of the same color; otherwise, it is a normal 
pixel. For example, the currently selected pixel is (5,6). 
It is a peak if | (5,6)- (5,4) | >T1 and | (5,6)- (5,8) | >T1; 
otherwise the pixel (5,6) is a normal pixel. 
5 Second, it is further determined whether the identified 

peak is a defect. A peak is identified as a defect if it 
meets the following criteria; 

1. Each of the two pixels immediately adjacent to the 
peak has a color difference smaller than a threshold T2 from 

10 two adjacent pixels of the same color; 

2. All the other pixels in a pre-defined window 
positioned according to the location of the peak are normal 
pixels . 

For example, the pixel (5,6) is identified as a peak in 
15 the first step. It is a defect if | (5,5) -(5,3) | <T2, | 
(5,7) -(5,5) I <T2 and | (5, 9) -(5, 7) | <T2 , and all the other 
pixels in the window (4,2)-(5,D) are normal pixels, wherein 
the window is pre-defined as a matrix formed by the pixels 
located within 7 columns right and 4 columns left of the 
2 0 peak, and the row of and immediately above the peak. 

Third, the color value of the defect is corrected as a 
mean of the color values of two adjacent pixels of the same 
color. For example, the pixel (5,6) is identified as a 
defect in the second step. Its color value is corrected as 
25 the mean of the color values of the pixels (5,4) and (5,8). 

The thresholds Tl and T2 are programmable and the 
window may be defined as required. Further, the color value 
of the defect may be corrected in other ways and is not 
limited to the mean of adjacent pixel values. 
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The method for defect compensation in a color image 
sensor according to one embodiment of the invention will be 
more specifically described with reference to FIG. 3. 

In step 51, the thresholds Tl and T2 are predetermined 
5 and the window is pre-defined as a matrix composed of the 
pixels within columns and rows extended from a reference 
pixel. For example, the window is defined as a matrix 
composed of the pixels within 7 columns right and 4 columns 
left of the reference pixel (5,6), and the row of and 
10 immediately above the reference pixel (5,6), as shown in 
FIG. 2. 

In step 52, as the pixel data is read out from the 
array, each of the pixels is checked to determine whether it 
is a peak. The pixel is identified as a peak if it has 

15 differences larger than the threshold Tl from two adjacent 
pixels of the same color; otherwise, it is a normal pixel. 
In the 16*16 color pixel array shown in FIG. 2, when the row 
5 is read out and the pixel (5,6) is to be checked, the 
color differences respectively between the green pixels 

20 (5,6) and (5,8), (5,6) and (5,4) are compared to the 
threshold Tl . If they are both larger than Tl, the pixel 
(5,6) is identified as a peak and an indication bit ''1" for 
the pixel (5,6) is stored in a buffer; otherwise, the pixel 
(5,6) is a normal pixel and its indication bit is "0". 

25 In step 53, if the pixel is identified as a peak, the 

pixel is further checked to deteirmine whether it is 
defective before checking the next pixel in the row. The 
peak is identified as a defect if each of the two pixels 
immediately adjacent to the peak has a color difference 

30 smaller than the threshold T2 from two adjacent pixels of 



-6- 



Client Ref, :N/A 

Our ref : 0723 -9003 - US / f inal /Vincen t /S teve 

the same color, and all the other pixels in the pre-defined 
window positioned by using the peak as a reference pixel are 
normal pixels. In the 16*16 color pixel array shown in FIG. 
2, if the pixel (5,6) is identified as a peak, it should be 
5 further checked to determine whether it is a defect. The 
pixels immediately adjacent to the peak (5,6) are red pixels 
(5,5) and (5,7) so that the color differences between the 
red pixels (5,3) and (5,5), (5,7) and (5,5), (5,5) and 
(5,7), and (5,9) and (5,7) are compared to the threshold T2 . 

10 By the indication bits stored in the buffer, it is also 
determined whether all the other pixels in the window 
positioned by using the peak (5,6) as a reference pixel are 
normal pixels. If it is true and all the color differences 
are smaller than the threshold T2 , the peak (5,6) is 

15 identified as a defect. 

In step 54, the color value of each identified defect 
is corrected as the mean of the color values of two adjacent 
pixels of the same color. The color value of the defective 
green pixel (5,6) is corrected as the mean of the color 

20 values of the adjacent green pixels (5,4) and (5,8). 

The previously described defect compensation also 
applies to gray scale images and color images composed of 
magenta, yellow and cyan pixels. 

FIG. 4 shows an apparatus for defect compensation in a 

25 color image sensor according to one embodiment of the 
invention. It includes a processor 62 and a buffer 63. The 
processor 62 reads out the data of rows of pixels from the 
pixel array 61 and carries out the method shown in FIG. 3. 
The buffer 63 stores the indication bits of the pixels. The 

30 buffer 63 may reside in the pixel array 61 or processor 62. 
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It is noted that the size of the buffer 63 is much 
smaller than that of the line buffer used in conventional 
on-chip compensation. Only one indication bit for each of 
the pixels need to be stored in the buffer 63 while all the 
5 bits of the color value of each pixel are stored in the line 
buffer in conventional defect compensation. Thus, for an 8- 
bit color image, the buffer size for defect compensation in 
the present invention is 1/8 of that for the conventional 
defect compensation. Furthermore, unlike the conventional 

10 defect compensation wherein a peak is directly regarded as a 
defect, the peak is further checked to determine whether it 
should be identified as a defect, which decreases the number 
of mistakenly identified defects. 

In conclusion, the present invention provides a method 

15 and apparatus for on-chip defect compensation of a color 
image sensor without using large memory or line buffer. The 
peaks are identified by a 1-D algorithm and only one 
indication bit for each peak is stored in the buffer. The 
defects are identified further by the 1-D algorithm using 

20 the peak information in the buffer. This eliminates the 
need for a large line buffer to store the values of the 
pixels and decreases the cost of the sensor. 

The foregoing description of the preferred embodiments 
of this invention has been presented for purposes of 

25 illustration and description. Obvious modifications or 
variations are possible in light of the above teaching. The 
embodiments were chosen and described to provide the best 
illustration of the principles of this invention and its 
practical application to thereby enable those skilled in the 

30 art to utilize the invention in various embodiments and with 
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various modifications as are suited to the particular use 
contemplated. All such modifications and variations are 
within the scope of the present invention as determined by 
the appended claims when interpreted in accordance with the 
5 breadth to which they are fairly, legally, and equitably 
entitled. 
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